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We study the decay 5° -> D*+ D*~ K° s using (230 ± 2) x 1Q 6 BB pairs collected by the BABAR 
detector at the PEP-II B factory. We measure a branching fraction B{B° D* + D*~ K° s ) = 
(4.4 ± 0.4 ± 0.7) x I0~ 3 and find evidence for the decay B° D*~D+ (2536) with a significance of 
4.6 a. A time-dependent CP asymmetry analysis is also performed to study the possible resonant 
contributions to B° — > D* + D*~ K® and the sign of cos2/3. Our measurement indicates that there is 
a sizable resonant contribution to the decay B° — > D* + D*~ from a unknown Df ± state with large 
width, and that cos2/3 is positive at the 94 % confidence level under certain theoretical assumptions. 

PACS numbers: 13.25.Hw, 12.15.Hh, 11.30.Er 



In the standard model framework, CP violation 
arises from a complex phase in the Cabibbo-Kobayashi- 
Maskawa (CKM) quark- mixing matrix ll|. Measure- 
ments of CP asymmetries by the BABAR [J and Belle Q 
collaborations have firmly established this effect in the 
decay B° — > J/ipK® and related modes that are gov- 
erned by the b — > ccs transition. Since both B° and B° 
mesons can decay to the final state D* + D*~ and this 
process is dominated by a single weak phase, FT-emission 
b —> ccs transition, a time-dependent CP violating asym- 
metry is expected. 

In the approximation of neglecting penguin contribu- 
tions for the decay B° — > D* + D*~ if", there is no direct 
CP violation. The time-dependent decay rate asymmetry 
of B° -> D*+D*-K° in the half Dalitz space s+ < s~ or 
s + > s~ can be written as |5|| 



A(t) 



^B° 



r 



B" 



2 J s i 



sin2/3 - 



r) y -^cos(Am d t) - 
Jo 

2J s2 \ 
f- r] y - cos2/3 ) sin(Am c ;t),(l) 



Jo 



where 



c + = 



l (D*+K°) and s~ = m 2 (D*-K° s ), T 



B" 



(r g0 ) is the decay rate for B° (B°) to D*+D*~K° at 
a proper time t after production, Arra^ is the mass dif- 
ference between the two B° mass eigenstates, and rj y — 
— l(+l)fors + < s~(s + > s~). The parameters J , J c ,J s i 
and J S 2 are the integrals over the half Dalitz phase space 
with s+ < s~ of the functions \a\ 2 + \a\ 2 , \a\ 2 - \a\ 2 , 
7Ze(aa*) and Xm(aa*), where a and a are the decay am- 
plitudes of B° -> D*+D*-K° s and B° -> P*+P*-p°, 
respectively. 

If the decay B° — > D* + D*~ K® has only a non-resonant 
component, the parameter J S 2 — and J c is at the few 
percent level The CP asymmetry can be extracted 
by fitting the B° time-dependent decay distribution. The 
measured CP asymmetry is sin2/3 multiplied by a factor 
of 2J s i/Jo because the final state is an admixture of CP 
eigenstates with different CP parities. In this case, the 
value of the dilution factor 2J s i/Jq is estimated to be 
large [||, similar to the decay B° — » D* + D*~ . 

The situation is more complicated if intermediate reso- 
nances such as Dfj are present. In this case, the param- 
eter J S 2 is non-zero and J c can be large. The resonant 



components are expected to be dominated by two P-wave 
excited D s \ states 0. One such state is 15^(2536) that 
has a narrow width and does not contribute much to J S 2 . 
It can be easily removed by imposing a mass window re- 
quirement. The other resonant state is predicted in 
the quark model [(| to have a mass above the D* + K ° 
mass threshold with a large width. In this case, the J S 2 
can be large. Therefore by studying the time-dependent 
asymmetry of B° — > D* + D*~ K° s in two different Dalitz 
regions, the sign of cos 2/3 can be determined for a suf- 
ficiently large data set using the method described in 
Refs. [HSU- This would allow the resolution of the j3 — » 
7r/2 — (3 ambiguity despite the large theoretical uncer- 
tainty of 2J S 2/ Jq. Bowever, if the unknown P-wave 
is the newly discovered P+ 7 (23I7) or £^(2460), both of 
which lie below the D* + K® mass threshold, then it will 
not contribute to the decay B° — » D* + D*~K°. As a re- 
sult, the time dependent analysis of B° — » D* + D*~ 
not only has a potential to measure the sign of cos2/3, 
but also can help us to understand the possible structure 
of the excited charm meson spectrum. 

In this paper, we present an improved measurement of 
the branching fraction of the decay B° -» D* + D*-R° s Q 
and a search for intermediate resonant decays. We also 
perform a time-dependent CP asymmetry analysis to 
study the possible resonant contributions and the sign 
of cos2/3. 

The data used in this analysis comprise (230 ± 2) mil- 
lion T(45) -> BB decays collected with the BABAR de- 
tector at the PEP-II storage rings. The BABAR detector 
is described in detail elsewhere [ljj. We use a Monte 
Carlo (MC) simulation based on GEANT4 [ll| to val- 
idate the analysis procedure and to study the relevant 
backgrounds. 

We select B° — > D* + D*~K a 3 decays by combin- 
ing two oppositely charged D* candidates reconstructed 
in the modes D*+ -> P°7r+ and D*+ -> P+tt 
with a K° candidate. We include the P*+P* _ com- 
binations (P°7r+,P 7O and (P°7r+, P~tt ), but not 
(P + 7T°, P~7r°) because of the small branching fraction 
and large backgrounds. To suppress the e + e~ — » qq (q = 
u,d,s, and c) continuum background, we require the ra- 
tio of the second and zeroth order Fox- Wolfram mo- 
ments to be less than 0.5. 
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Candidates for D° and D + mesons are reconstructed 
in the modes D° — > K~ir + , K~ir + 7r°, K~ir + ir + ir~ , and 
D + — > X _ 7r + 7r + , by selecting track combinations with 
invariant mass within ±2 a of the nominal D masses |l3j . 
The resolution cr is measured using a large data sam- 
ple of inclusive D decays. It is equal to 7.0 MeV/c 2 for 
D° -> K-7T+ decays, 13.5 MeV/c 2 for D° -> K-jt+tt" 
decays, 5.7 MeV/c 2 for D° — > i^ _ 7r + 7r _ 7r + decays, and 
5.6 MeV/c 2 for £>+ -» £r-7r+7r+ decays. 

The K® candidates are reconstructed from two 
oppositely-charged tracks with an invariant mass within 
15 MeV/c 2 of the nominal K® mass ^3|, which is equiv- 
alent to slightly less than 5cr of the measured K® mass 
resolution. The x 2 probability of the tt + tt~ vertex fit 
must be greater than 0.1%. To reduce combinatorial 
background, we require the measured proper decay time 
of the K° to be greater than 3 times its uncertainty. 
Charged kaon candidates, except for the one in the de- 
cay D° — > iiT~7r + , are required to be inconsistent with 
the pion hypothesis, as inferred from the Cherenkov an- 
gle measured by the Cherenkov detector and the ioniza- 
tion energy loss measured by the charged-particle track- 
ing system [ljj. Neutral pion candidates are formed 
from pairs of photons detected in the electromagnetic 
calorimeter [lfjj, each with energy above 30 MeV. The 
mass of the pair must be within 30 MeV/ c 2 of the nomi- 
nal 7T° mass, and their summed energy is required to be 
greater than 200 MeV. In addition, a mass-constrained 
fit is applied to the tt° candidate. 

The D° and D + candidates are subject to a mass- 
constrained fit prior to the formation of the D* + can- 
didates. The slow 7T+ from the D* + decay is required 
to have a momentum in the T(4S) center-of-mass (CM) 
frame less than 450 MeV/c. The slow tt° from the £>*+ 
must have a momentum between 70 and 450 MeV/c in 
the CM frame. No requirement on the photon-energy 
sum is applied to the ir° candidates from the D* + de- 
cays. The D* + mass is required to be within 4 MeV/c 2 
of the nominal D* + mass, corresponding to slightly more 
than 3 u of the measured D* + mass resolution. 

For each B° — > D* + D*~K° candidate, we calculate 
the difference of the B° candidate energy E* B from the 



beam energy ££ earo , AE = E* B 



£Sca,„> ^ the CM 



frame. In order to reduce the combinatorial background 
further, \AE\ is required to be less than 25 MeV, which 
is equivalent to 2.5 cr of the measured AE resolution. 

The beam energy-substituted mass, toes = 
V ^Bcam — P*b ' wnere P*b 1S the B° candidate mo- 
mentum in the CM frame, is used to extract the signal 
yield from the events satisfying the aforementioned selec- 
tion. We select B° candidates with toes > 5.23 GeV/c 2 . 
On average we have 1.25 B° candidates per event. If 
more than one candidate is selected in an event, we 
retain the one with the smallest |A£|. Studies using MC 
samples show that this procedure results in the selection 
of the correct B° candidate more than 95 % of the time. 



The total probability density function (PDF) is the 
sum of the signal and background components. The sig- 
nal toes PDF is modeled by a Gaussian function and the 
combinatorial background is described by an ARGUS |bj ] 
function. MC studies show that there is a small peaking 
background from B + — > D*°D* + K® in which a £>° origi- 
nating from a D*° decay is combined with a random soft 
7r~ to form a D*~ candidate. The peaking background 
is described by the same PDF as the signal, its fraction 
with respect to the signal yield is fixed to be 1.4%, de- 
termined from the MC simulation. An unbinned maxi- 
mum likelihood (ML) fit to the toes distribution yields 
201 ± 17(stat) signal events, where the mean and width 
of the signal Gaussian, as well as the ARGUS shape pa- 
rameters are allowed to float in the fit. In the region of 
toes > 5.27 GeV/c 2 , the signal purity is approximately 
79 %. The fit result is shown in Fig. la. 

To correct for variations in signal efficiency across the 
D* + D*~K® Dalitz plane, we calculate the branching 
fraction using the sPlots method (ljj: 



B 



E W s ig(TO E S,i) 
TV _ . f . . K '' 
j 1V BB tl Usuh 



(2) 



where the sum is over all events i, q is the efficiency 
estimated from the simulated events in the vicinity of 
each data point in the Dalitz plane, Z? su b is the product 
of the branching fractions of the sub-decays, and i s 
an event-dependent signal weight that is defined as [15J: 



W S 1 



;( TO ES,i) 



T Ns V- 
2^=1 "si 



jPj(mES,i) 



Vf ; .V/> ; (/„ K .,0 



(3) 



which is calculated from the yield Nj of the j-th PDF 
component Pj in the fit, and the covariance matrix ele- 
ments V s i g j between the signal yield iV sig and Nj. The 
N s is the number of PDF components in the fit. 

We investigate the production of intermediate res- 
onances by examining the invariant mass distribution 
of the Z?* ± and K® combinations. Fig. lb shows 
the projected distribution of i^D^K®) from B° — > 
D* + D*~ if" signal events after efficiency correction us- 
ing the sPlots technique. A peak is seen at the value 
of ££(2536) mass. We do not observe evidence of the 
££(2573). The events tend to cluster toward lower val- 
ues of m{D* ± K° s ) (below about 2.9 GeV/c 2 ), in contrast 
to the phase space model, as shown in Fig. lb. 

To extract the signal yield of B° -> £>*~££ (2536), we 
perform an unbinned ML fit to the Ato = m{D* ± K®) — 
m(D*^) — m(K®) distribution in the region toes > 
5.27 GeV/c 2 with a PDF given by the sum of a Gaus- 
sian shape for the signal and a threshold function 
Am a exp(6ATO) for the background. The mean and 
width of the signal Gaussian, as well as the background 
PDF parameters a and b are allowed to float in the fit. 
The fit yields 12.3 ± 4.0(stat) signal events, as shown in 
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FIG. 1: (a) Measured distribution of jties- The solid line is the projection of the fit result. The dashed line represents the 
background components, (b) The efficiency-corrected yield of B° — > D* + D*~ signal events as a function of m(_D* ± Kg) 
in data (points) and in three-body phase-space signal MC (histogram) with an arbitrary normalization. Errors shown are 
statistical only. Note that the vertical axis shows events per unit rn(D* ± K$), not the events in each bin. (c) Measured 
distribution of m(D* ± Ks) — m(D* ± ) ~ m(Ks) in the region jties > 5.27 GeV/c 2 . The solid line is the projection of the fit 
result. 



Fig. lc. The significance is estimated to be 4.6 a using the 
log-likelihood ratio between a fit with signal and another 
with none. The significance is dominated by the sta- 
tistical uncertainty and has little contribution from the 
systematic uncertainty corresponding to the estimate of 
the signal yield. The fitted signal mean and width are 
consistent with the MC simulation. We repeat the fit in 
different Am regions up to the kinematic limit, as well 
as using different background parameterizations. All of 
these give consistent signal yields of 13^(2536). We also 
examine the Am distribution in the jties < 5-27 GeV/c 2 
region, and see no peaking structure. 

The systematic uncertainties of the branching fraction 
measurements are dominated by the uncertainty of the 
charged track reconstruction efficiency (10.7%). Other 
sources also contribute to the systematic errors, such 
as the kaon particle identification efficiency (3.9%), 7r° 
reconstruction efficiency (3.5%), branching fractions of 
the D decays (5.8%), determination of the number of 
BB in the data sample (1.1%), event selection criteria 
(5.0 %), and the estimate of the peaking background frac- 
tion (1.8%). The measured branching fraction is: 

B(B° -» D*+D*-K° s ) = (4.4 ± 0.4 ± 0.7) x 10~ 3 , 



where the first uncertainty is the statistical and the sec- 
ond is systematic. Our result is in good agreement with 
the previous BABAR measurement |9j. We also measure 
the intermediate resonant decay branching fraction and 
find: 

B(B° -» D*-£>+(2536)) x B(£>+ (2536) -> D*+K° s ) 
= (4.1 ±1.3 ±0.6) x 10~ 4 . 

The fraction of the decay B° -> D*+D*-R a s through 
the intermediate -0^(2536) resonance is measured to be 
0.092 ± 0.024(stat) ± O.OOl(syst). 

We subsequently perform a time-dependent analysis 
using the event sample described previously. In the time- 
dependent analysis, we require that the invariant mass of 
the D and K® combination be larger than 2.55 GeV/c 2 
in order to reject the narrow 1)^(2536) resonant decays. 

For the time-dependent CP analysis, we use informa- 
tion from the other B meson in the event to tag the initial 
flavor of the fully reconstructed B° — > D* + D*~ can- 
didate. The decay rate /+(/-) for a neutral B meson 
accompanied by a B°(B°) tag is given by 



/±(At) cx e 



-|At|/r fl0 



(1 T Aw) ± (1 - 2ui) 



f/y-p cos (Am^At) 
Jo 



r 



2 J s i 



2 J 

sin2/3 + r/y — p- cos2/3 I sin (Am^At) 
Jo 



ill 



where At = t rcc — ftag is the difference between the proper 
decay time of the reconstructed signal B meson (B IOC ) 
and that of the tagging B meson (B tElg ), tqo is the J5° 



lifetime, and Am<; is the mass difference determined from 
the B°-B° oscillation frequency The average mistag 
probability oj describes the effect of incorrect tags, and 
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At[ P S] 



FIG. 2: (a) The distribution of At in the region m^s > 
5.27 GeV/c 2 for B° (B°) tag candidates in the half Dalitz 
space s + < s~ (rj y — —1). The solid (dashed) curve rep- 
resents the fit projections in At for B° (B°) tags, (b) The 
raw asymmetry (N B o ~ Ng )/(N B o + Ng ), as functions of 
At, where N B o (Ng ) is the number of candidate with B° 
(B°) tag. (c) and (d) contain the corresponding information 
for the B° candidates in the other half Dalitz space s + > s~ 
(Vv = +1). 



Aw is the difference between the mistag rate for B° and 
B°. 

The technique used to measure the CP asymmetry is 
analogous to that used in previous BABAR measurements 
as described in Ref. [IJlllS- We calculate the time inter- 
val At between the two B decays from the measured sep- 
aration Az between the d ecay vertices of B rec and Btag 
along the collision (z) axis yjj. The z position of the J5 rec 
vertex is determined from the charged daughter tracks. 
The Btag decay vertex is determined by fitting charged 
tracks not belonging to the B rec candidate to a common 
vertex, employing constraints from the beam spot loca- 
tion and the J5 rec momentum . Only events with a At 
uncertainty less than 2.5 ps and a measured | At| less than 
20 ps are accepted. We perform a simultaneous unbinned 
maximum likelihood fit to the At and ities distributions 



to extract the CP asymmetry. The signal PDF in At 
is given by Eq. |H convolved with an empirical At reso- 
lution function 16]. Both the signal mistag probability 
and At resolution function are determined from a sample 
of neutral B decays to flavor eigenstates, Bfl av . 

The background At distributions are parameterized 
with an empirical description that includes zero and non- 
zero lifetime components . We also allow the non-zero 
lifetime background to have effective CP asymmetries 
and let them float in the likelihood fit. 

The fits to the data yield 



Jc 

Jo 
sin2 (3 

Jo 

2Js2 

~Jo~ 



cos2/3 



0.76 ± 0.18(stat) ± 0.07(syst) 
0.10 ± 0.24(stat) ± 0.06(syst) (5) 
0.38 ± 0.24(stat) ± 0.05(syst) 



Fig. |21 shows the At distributions and asymmetries in 
yields between B° and B° tags, overlaid with the projec- 
tion of the likelihood fit result. The effective CP asym- 
metries in the background are found to be consistent with 
zero within statistical uncertainties. As a cross check, we 
also repeat the fit by allowing the B° lifetime to float. 
The obtained B° lifetime is in a good agreement with its 
world average jl.'il| within the statistical uncertainty. 

The sources and estimates of systematic uncertainties 
are summarized in Table [I] Since the signal reconstruc- 
tion efficiency is not uniform over the entire Dalitz space, 
the different CP components may not have the same ac- 
ceptance. Therefore the measured parameters will devi- 
ate slightly from their true values. We estimate the pos- 
sible bias using the signal MC weighted according to the 
expected theoretical Dalitz distributions in Ref. [5j. Be- 
cause of the lack of knowledge of the unknown Df x state, 
we vary its mass and width over a wide range. The largest 
bias of the measured parameters J c /Jo, (2 J s i/ Jo) sin2/3 
and (2J s i/Jo) cos2/3 are taken as the corresponding sys- 
tematic uncertainties on the acceptance effect. 

The other systematic uncertainties arise from the pos- 
sible backgrounds that tend to peak under the signal 
and their CP asymmetries, the assumed parameteriza- 
tion of the At resolution function, the possible differences 
between the B flav and B a -> D*+ D*~ K° tag gmg per- 
formances, knowledge of the event-by-event beam-spot 
position, and the possible interference between the sup- 
pressed b — > ucd amplitude and the favored b — > cud 
amplitude for some tag-side decays They also in- 

clude the systematic uncertainties from the finite MC 
sample used to verify the fitting method. All the system- 
atic uncertainties are found to be much smaller than the 
statistical uncertainties. 

In summary, we have reported an improved branching 
fraction measurement of the decay B° — > D* + D*~ K® 
that supersedes the previous BABAR result 0. We also 
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Source 


I 


II 


III 


Acceptance 


0.060 


0.040 


0.030 


Peaking backgrounds 


0.009 


0.016 


0.002 


At resolution function 


0.015 


0.006 


0.008 


Mistag fraction differences 


0.016 


0.015 


0.015 


Detector Alignment 


0.005 


0.015 


0.015 


Am d , t b 


0.001 


0.001 


0.001 


MC statistics 


0.021 


0.032 


0.032 


Others 


0.005 


0.004 


0.005 


Total 


0.068 


0.058 


0.050 



TABLE I: Sources of systematic error on J c /Jo (column I), 
(2J s i/Jo) sin2/3 (column II) and (2J s i/Jo) cos2/3 (column III). 

find evidence for the decay B° -> D*~D+ X (2536) with 
4.6 a significance. A time-dependent CP asymmetry 
analysis has also been performed. The measured J c /Jo 
is significantly different from zero, which may indicate 
that there is a sizable resonant contribution to the de- 
cay B a — > D* + D*~K° from a unknown D% x state with 
large width, according to Ref. We measure that 

(2J s2 /J ) cos2/3 = 0.38 ± 0.24(stat) ± 0.05(syst). Under 
the assumption that there is a significant broad resonant 
contribution to the decay B° — > D* + D*~ it implies 
that the sign of cos2/3 is preferred to be positive at the 
94% confidence level if the theoretical parameter J^/^o 
is positive, as predicted in Ref ||. 
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